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RECORDING MEDIUM HAVING A DATA STRUCTURE FOR 
MANAGING REPRODUCTION OF GRAPHIC DATA AND RECORDING 
AND REPRODUCING METHODS AND APPARATUSES 

5 FOREIGN PRIORITY 

[0001] The present invention claims priority under 35 
U.S.C. 1 19 on Korean Application No. 10-2002-060683 filed October 4, 
2002; the contents of each above-cited Korean applications are 
incorporated by reference in their entirety. 

10 BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] The present invention relates to a method of 
managing graphic data for a high-density recording medium such as 
an optical disk (e.g., a Blu-ray Disc ROM (BD-ROM)). 

15 

Description of Related Art 

[0003] Recording media such as optical disks capable of 

recording large amounts of high-quality digital video/audio data, for 
example, DVDs (digital versatile disks) are now commercially 
20 available on the market. The types of DVDs include DVD-Video, 
DVD-VR (Video Recording), DVD-Audio, and DVD-AR (Audio 
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Recording). 

[0004] In the DVD-Video, graphic data to be reproduced 
in synchronization with a video/audio data stream is defined by the 
DVD-private format and designated as sub-pictures. 

5 [0005] A sub-picture of the graphic data is of size 

720x480 pixels and has a palette with 2-bit color depth, which can 
support up to 16 colors. The graphic data is recorded on the DVD 
after being multiplexed with the video/audio stream. 

[0006] A run-length coding method according to the 

10 DVD-Video standard is applied to the graphic data in which display 
control information about sub-picture data is included. The display 
control information includes information on display timing, color 
change, blending ratio change, display position, size selection, etc. 

[0007] Operations for providing various graphic effects 

15 to the graphic data, such as scroll-up/down, fade/wipe-in/out, and 
color change, can be performed selectively on a time basis. 
Navigation information for the palette information is defined for each 
title and program chain and includes information on 16 colors and 
the number and attributes of sub-pictures. 

20 [0008] The attributes of sub-pictures may include 

caption information, director's comments, and aspect ratio 
information for various applications as well as coding mode 
information and language information. 
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[0009] An optical disk reproducing apparatus such as a 
DVD player displays the main video image and some or all of the 
graphic image of a sub-picture unit (SPU) as shown in Fig. 1 by 
blending the images using navigation information, wherein the 
5 graphic image of the sub-picture unit (SPU) is overlaid on the main 
video image on a presentation time basis. 

[0010] As shown in FIG. 2, sub-picture packs (SP_PCKs) 
are recorded intermittently among audio packs (Audio_PCKs) and 
video packs (Video„PCKs) recorded successively. Each of the audio 
10 and video packs is of size 2048 bytes. 

[OOll] During data reproduction, the sub-picture packs 

are read and then grouped into a sub-picture unit (SPU), which 
includes a sub-picture unit header, pixel data, and display control 
information. 

15 [0012] The sub-picture unit header includes the data 

size of the sub-picture unit. The pixel data includes 2-bit depth 
bitmap data encoded by the run-length coding method. The palette 
information for the pixel data is recorded as separate navigation 
information. 

20 [0013] The optical disk reproducing apparatus 

reproduces the pixel data along with the audio and video data, the 
pixel data being synchronized with the audio and video data. As 
alluded to above, the apparatus displays the main video image and 
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some or all of the graphic image of a sub-picture unit (SPU) by 
blending the images using the navigation information, wherein the 
graphic image of the sub-picture unit (SPU) is overlaid on the main 
video image in various ways on a presentation time basis. 
5 [0014] The standardization for high-density read-only 

optical disks such as the Blu-ray disc ROM (BD-ROM) is still under 
way. A method for effective managing graphic data recorded on the 
high-density read-only optical disk such as a BD-ROM is not yet 
available. 

10 SUMMARY OF THE INVENTION 

[0015] The recording medium according to the present 

invention includes a data structure for managing reproduction of 
graphic data. 

[0016] In one exemplary embodiment, a data area of the 

15 recording medium includes one or more graphic segments, each of 
which includes graphic data, multipled with other data. For example, 
the other data includes movie data. Each graphic segment includes a 
plurality of transport packets. 

[0017] In one exemplary embodiment, each transport 

20 packet in a graphic segment has a same packet identifier (PID). 

[0018] In another exemplary embodiment, at least one 

transport packet in a graphic segment includes an identifier that the 
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transport packet is part of a graphics packet. 

[0019] In a further exemplary embodiment, at least one 

transport packet in the a graphic segment includes a time stamp. 

[0020] In a still further exemplary embodiment, at least 

5 one transport packet in a graphic segment includes graphic 
information for managing reproduction of graphic images. 

[0021] The present invention further provides 

apparatuses and methods for recording and reproducing the data 
structure according to the present invention. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

[0022] The accompanying drawings, which are included 

to provide a further understanding of the invention, illustrate the 
preferred embodiments of the invention, and together with the 
description, serve to explain the principles of the present invention. 
15 [0023] In the drawings: 

[0024] FIG. 1 illustrates a graphical representation of 

main video overlaid with graphic images according to the DVD-Video 
standard; 

[0025] FIG. 2 illustrates a structure of graphic data in 

20 the DVD-Video standard; 

[0026] FIG. 3 illustrates a graphical representation of a 

plurality of graphic images of different sizes and color depths to be 
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overlaid on a main picture according to the present invention; 

[0027] FIG. 4 illustrates a graphical representation of a 

main data overlaid with a plurality of graphic images of different sizes 
and color depths; 

5 [0028] FIGS. 5-8 illustrate examples showing how 

graphic images and navigation information are recorded in a main 
stream on a high density reocrdin medium according to the present 
invention; 

[0029] FIG. 9 illustrates a preloading operation for 

10 loading graphic data recorded in a segment into a graphic image 
buffer; 

[0030] FIGS. 10-13 illustrate exemplary embodiments of 

graphic information in accordance with the invention; 

[0031] FIGS. 14-20 illustrate exemplary embodiments of 

15 navigation information in accordance with the invention; and 

[0032] Fig. 21 illustrates a schematic diagram of an 

embodiment of an optical disk recording and reproducing apparatus 
according to the present invention. 

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS 
20 [0033] In order that the invention may be fully 

understood, exemplary embodiments thereof will now be described 
with reference to the accompanying drawings. 
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[0034] FIG. 3 is a graphical representation of an 

embodiment of a method of managing graphic data for a high-density 
optical disk in accordance with the present invention. A main picture 
image has one or more corresponding graphic images, which have 
5 different sizes and color depths. 

[0035] As shown, the main picture of size 1920x1080 

pixels has three different associated graphic images, a graphic image 
of size 1920x1080 pixels, a graphic image of size 1280x1080 pixels, 
and a graphic image of size 640x1080 pixels. 
10 [0036] The three graphic images have different color 

depths. The 1920x1080 graphic image has an 8-bit color depth, the 
1280x1080 graphic image has an 8-bit or 16-bit color depth, and the 
640x1080 graphic image has an 8-bit, 16-bit, or 24-bit color depth. 

[0037] As shown in FIG. 4, a plurality of different graphic 

15 images, graphic images 1, 2, and 3, may be simultaneously overlaid 
on one main picture image and the plurality of graphic images may 
have different sizes and color depths. The plurality of graphic images 
may be managed individually or as a group. 

[0038] The overlaid graphic images and navigation 

20 information therefor are multiplexed with main video and audio 
streams, which will be described in detail below. 

[0039] FIGS. 5-8 illustrate examples showing how 

graphic images and navigation information are recorded in a main 
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stream on a high density recording medium such as a BD-ROM. As 
shown in FIG. 5, multiple graphic images are recorded in a prescribed 
recording segment (e.g., A, B, or C) of an audio/video main stream 
recorded in a data area of a BD-ROM. The multiple graphic images are 

5 multiplexed in the prescribed segment. 

[0040] Graphic images recorded in the prescribed 

segment, (e.g., A) are graphic images to be overlaid with the main 
stream recorded after the segment. A graphic image is recorded as a 
plurality of 192-byte source packets, each comprising a 4-byte TP 

10 (Transport Packet) extra header and a 188-byte MPEG2 TP. In the 
recording segment, only graphic images are recorded or graphic 
images are multiplexed with the main stream. 

[0041] The 4-byte TP extra header may include 2-bit 

copy protection information and 30-bit navigation information for an 

15 associated graphic image (e.g., Image_start_end_flag described in 
detail below) or a 30-bit packet arrival time stamp. 

[0042] In detail, if a source packet is associated with a 

graphic image, the TP extra header thereof includes copy protection 
information and graphic information (e.g., Image_start_end_flag 

20 described in detail below). Otherwise, the TP extra header includes 
copy protection information and a packet arrival time stamp. 

[0043] The header of an MPEG2 TP includes a packet 

identifier (PID). The PID is given a unique value, for example, 
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'PID=0xl023' when the packet is a graphics packet. 

[0044] Because graphic images are recorded as MPEG2 

TPs in the recording segment, the recording format of the graphic 
images is compatible with that of movie data, for example, movie data 
5 of the BD-RE format. When graphic images and a main stream are 
multiplexed in the prescribed recording segment, the main stream 
corresponds to one among MPEG2 movie data, audio data, or still 
images. 

[0045] As shown in FIG. 6, the beginning part of the 

10 prescribed recording segment includes a source packet of graphic 
information for managing reproduction of the graphic images recorded 
therein. An optical disk reproducing apparatus performs reproduction 
of the graphic images by checking the number of graphic images, data 
size, etc using the graphic information. 
15 [0046] The graphic images recorded in the prescribed 

recording segment can be identified by the source packet of the 
graphic information. As shown in FIG. 7, the graphic information 
contained in the payload of the source packet may include fields of 
graphic_start_end_flag, number_of_images, image_info indicating 
20 attributes and properties of each graphic image (e.g., position to 
display a graphic image, presentation time to display a graphic image, 
duration to display a graphic image, etc.), and image_data_size 
indicating the size of each graphic image or start position information. 
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[00471 If the graphic_start_end_flag field is *0\ it 

indicates the beginning of the graphic data; otherwise it indicates the 
ending of the graphic data. Some of the fields of the graphic 
information can be used as information about one graphic image or all 
5 of the graphic images. 

[0048] In an example shown in FIG. 8, the graphic 

images recorded in the prescribed recording segment can be identified 
by the TP extra header, wherein the TP extra header of the first source 
packet of each graphic image includes 2-bit copy protection 
10 information and 30-bit graphic information. The graphic information 
can be defined in the same manner as the graphic information shown 
in FIG. 7. 

[0049] The TP extra header of the other source packets 

includes 2-bit copy protection information and other 30-bit 
15 information such as a packet arrival time stamp. 

[0050] If a high density recording medium such as a BD- 

ROM disk having graphic images and graphic information recorded in 
the aforementioned manner is inserted into an optical disk 
reproducing apparatus, the apparatus conducts a preloading 
20 operation that loads all the graphic data recorded in a prescribed 
segment into a graphic image buffer, as shown in FIG. 9. 

[0051] When reproducing a main stream (e.g., movie 

video, audio, or still images) recorded after the prescribed segment, 
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the optical disk reproducing apparatus sequentially reproduces the 
graphic images in the graphic image buffer along with the main 
stream using the graphic information as described above with 
reference to FIG. 7 and FIG. 8. 
5 [0052] When the graphic images are reproduced along 

with a movie as shown in FIG. 10, the graphic images are overlaid on 
the movie video, wherein the graphic images may be overlaid on the 
movie video simultaneously or individually in succession and the 
positions of the graphic images on the movie video may be different 

10 from each other. 

[0053] When the graphic images are reproduced along 

with an audio-only clip as shown in FIG. 11, one or multiple graphic 
images are displayed at a particular position(s) of the screen, wherein 
the graphic images may be presented simultaneously or individually 

15 in succession as in animations and the positions of the graphic 
images may be different from each other. 

[0054] When the graphic images are reproduced along 

with still images as shown in FIG. 12, the graphic images are overlaid 
on the still images, wherein the graphic images may be overlaid on 

20 one still image simultaneously or individually in succession and the 
positions of the graphic images on the still images may be different 
from each other. 

[0055] The graphic images may be presented along with 
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audio and still images as shown in FIG. 13, wherein the graphic 
images are overlaid on the still images at a particular position(s). The 
graphic images may be overlaid on one still image simultaneously or 
individually in succession and the positions of the graphic images on 
5 the still images may be different from each other. 

[0056] In an embodiment of a method of recording and 

managing navigation information for reproduction of the graphic 
images as shown in FIG. 14, navigation information for one or 
multiple graphic images is stored in a playlist for playback control of a 
10 movie or audio-only clip A/V stream as graphic marks or playlist 
graphic indicators. 

[0057] When the navigation information is stored as 

graphic marks, the mark syntax of, for example, the BD-RE standard 
may be used for the graphic mark by extending the meaning of each 
15 field thereof, as shown in FIG. 15. Accordingly only the difference from 
the BD-RE standard will be described. The mark_type field of the 
graphic mark is given a unique value that is not defined in the BD-RE 
standard, for example, , mark_type=0xl3'. 

[0058] The graphic mark includes 

20 ref_to_graphic_start_index field for indexing a beginning graphic image 
or graphic image group, duration information for specifying display 
duration required for all of the graphic images, and 
number_of_graphic_images field indicative of the number of graphic 
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images to be displayed. 

[0059] For each graphic image, the graphic mark further 

includes a ref_to_graphic_image_index field for indexing each of the 
graphic images, display timing information for specifying display start 
5 time and display duration for each of the graphic images, display_info 
field for specifying display position and window size of each of the 
graphic images on a main image, and display_effect field for providing 
various graphic effects such fade/wipe-in/wipe-out for each of the 
graphic images. 

0 [0060] When the navigation information is stored as 

playlist graphic indicators, the syntax of the playlist graphic indicator, 
which is not defined in the BD-RE, is newly defined and a unique 
version number that is not used in the BD-RE is assigned to the 
playlist graphic indicators, as shown in FIG. 16. 

> [0061] The playlist graphic indicator information field 
includes a length indicator indicating a length of the playlist still 
indicator inforation field and a number_of_Graphic_Display_positions 
field in cheating the number of graphic display postions. For each 
graphic display position, the playlist graphic indicator field further 

> includes a graphic_display_start_time_stamp field, and duration 
information. 

[0062] The playlist graphic indicator further includes 

number_of_graphic_images field indicative of the number of graphic 



13 



Attorney Docket No. 1740-000059/US 

images to be displayed. For each image, the folloing additional fields 
are provided: a ref_to _graphic_image_index field for indexing each of 
the graphic images, display timing information for specifying display 
start time and display duration for each of the graphic images, 

5 display_info field for specifying display position and window size of 
each of the graphic images on a main image, and display_effect field 
for providing various graphic effects such fade/wipe-in/wipe-out. 

[0063] In another embodiment shown in FIG. 17, 

navigation information for one or multiple graphic images is stored as 

10 sub-playitems in a playlist for playback control of a movie or audio- 
only^ clip A/V stream. The syntax of the sub-playitem for graphic 
images is extended from the syntax of the general sub-playitem 
defined for managing dubbed audio in the BD-RE. 

[0064] As shown in FIG. 18, the syntax of the sub- 

15 playitem for graphic images conforms to the syntax of the general sub- 
playitem but some fields are extended to include graphic control 
information. Accordingly, only the differences from the general 
definition will be described. The length field of the sub-playitem is 
given a unique value greater than or equal to the 26 bytes that is 

20 defined in Ver. 1.0 of BD-RE standard. 

[0065] The sub-playitem includes a Clip_codec_identifier 

field for indicating that the sub-playitem is associated with a graphic 
image and a Subplayltem_type field for specifying a path for displaying 
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the associated graphic image. For example, the Clip_codec_identifier 
field may have a value of 'GRAF' and the Subplayltemjype may have 
a value of 4. 

[0066] The sub-playitem includes SubPlayItem_IN_time 

5 field for indicating the display time of a beginning graphic image and 
SubPlayItem_OUT_time for indicating display duration or ending time 
of all of the graphic images. The sub-playitem further includes 
ref_to_graphic_image_index field for indexing each of the graphic 
images, display timing information for specifying display start time 
10 and display duration for each of the graphic images, display_info field 
for specifying display position and window size of each of the graphic 
images on a main image, and display_effect field for providing various 
graphic effects such fade/wipe-in/wipe-out for each of the graphic 
images. 

15 [0067] In another embodiment of a method of recording 

and managing navigation information for reproduction of graphic 
images along with still images, the navigation information is stored as 
still image information, which includes a graphic_display_info field, as 
shown in FIG. 19. The still image information may be stored in a 

20 playlist file or stored as an individual file. For example, the playlist 
graphic indicator of FIG. 16 may be newly defined as a graphic display 
information field in the still image information field. 

[0068] The graphic display information field includes a 
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length indicator indicating a length of the graphic display information 
field and a number__of_graphic_images field indicating the number of 
graphic images to be displayed. For each graphic image, the graphic 
display information field includes the fields of: a 
5 ref_to_graphic_image_index field for indexing each of the graphic 
images, display timing information for specifying display start time 
and display duration for each of the graphic images, display_info field 
for specifying display position and window size of each of the graphic 
images on a main image, and display_effect field for providing various 

10 graphic effects such fade/wipe-in/wipe-out, as described above with 
reference to FIG. 18. 

[0069] In an embodiment of a method of recording and 

managing navigation information for reproduction of graphic images 
as buttons on the screen, the navigation information is stored as 

15 Button_Info contained in menu information, as shown in FIG. 20. The 
menu information may be stored in a playlist file or stored as an 
individual file. 

[0070] Button information is proided for each button. 

The button information is navigation information for reproduction of 
20 graphic images to be displayed as a button. Each button information 
field includes a length field idnciating the length of the button 
information field, ref_to _graphic__image_index field for indexing each of 
the graphic images, display timing information for specifying display 
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start time and display duration for each of the graphic images, 
display_info field for specifying display position and window size of 
each of the graphic images on a main image, and display_effect field 
for providing various graphic effects such fade/wipe-in/wipe-out, as 

5 described above with reference to FIG. 18. 

[0071] Fig. 21 illustrates a schematic diagram of an 

embodiment of an optical disk recording and reproducing apparatus 
according to the present invention. As shown, an AV encoder 9 
receives and encodes data (e.g., movie video and audio data, only 

10 audio data, and/ or still image data). The AV encoder 9 outputs the 
encoded data along with coding information and stream attribute 
information. A multiplexer 8 multiplexes the encoded data based on 
the coding information and stream attribute information to create, for 
example, an MPEG-2 transport stream. A source packetizer 7 

15 packetizes the transport packets from the multiplexer 8 into source 
packets in accordance with the audio/video format of the optical disk. 
As shown in Fig. 21, the operations of the AV encoder 9, the 
multiplexer 8 and the source packetizer 7 are controlled by a 
controller 10. The controller 10 receives user input on the recording 

20 operation, and provides control information to AV encoder 9, 
multiplexer 8 and the source packetizer 7. For example, the controller 
10 instructs the AV encoder 9 on the type of encoding to perform, 
instructs the multiplexer 8 on the transport stream to create, and 
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instructs the source packetizer 7 on the source packet format. The 
controller 10 further controls a drive 3 to record the output from the 
source packetizer 7 on the optical disk. 

[0072] The controller 10 also creates the navigation and 

5 management information for managing reproduction of the data being 
recorded on the optical disk. For example, based on information 
received via the user interface (e.g., instruction set saved on disk, 
provided over an intranet or internet by a computer system, etc.) the 
controller 10 controls the drive 3 to record the data structures of Fig. 

10 5 on the optical disk. 

[0073] During reproduction, the controller 10 controls 

the drive 3 to reproduce this data structure. Based on the information 
contained therein, as well as user input received over the user 
interface (e.g., control buttons on the recording and reproducing 

15 apparatus or a remote associated with the apparatus), the controller 
10 controls the drive 3 to reproduce the data from the optical disk. For 
example, as discussed above with respect to the embodiments of the 
present invention, a still image or still images may be reproduced 
based on the navigation information provided in a still information file. 

20 [0074] The reproduced source packets are received by a 

source depacketizer 4 and converted into a data stream (e.g., an 
MPEG-2 transport packet stream). A demultiplexer 5 demultiplexes 
the data stream into encoded data. An AV decoder 6 decodes the 
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encoded data to produce the original data that was feed to the AV 
encoder 9. During reproduction, the controller 10 controls the 
operation of the source depacketizer 4, demultiplexer 5 and AV 
decoder 6. The controller 10 receives user input on the reproducing 
5 operation, and provides control information to AV decoder 6, 
demultiplexer 5 and the source packetizer 4. For example, the 
controller 10 instructs the AV decoder 9 on the type of decoding to 
perform, instructs the demultiplexer 5 on the transport stream to 
demultiplex, and instructs the source depacketizer 4 on the source 
10 packet format, 

[0075] While Fig. 21 has been described as a recording 
and reproducing apparatus, it will be understood that only a recording 
or only a reproducing apparatus may be provided using those portions 
of Fig. 2 1 providing the recording or reproducing function. 
15 [0076] The recording medium having a data structure for, 

and the methods and apparatuses of, managing graphic data for a 
high-density recording medium in accordance with the invention 
allows one or more graphic images to be overlaid on a movie video or 
still image simultaneously or individually in succession, allows 
10 graphic images to be presented along with audio, and allows 
displaying of various graphic images such as buttons for selecting 
associated functions. 

[0077] While the invention has been disclosed with 
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respect to a limited number of embodiments, those skilled in the art, 
having the benefit of this disclosure, will appreciate numerous 
modifications and variations there from. For example, while described 
with respect to a Blu-ray ROM optical disk in several instances, the 
5 present invention is not limited to this standard of optical disk or to 
optical disks. It is intended that all such modifications and variations 
fall within the spirit and scope of the invention. 
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